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Introduction 


The purpose of the School Panel Review Process is to assist the Commissioner of Education in 
determining whether State intervention is needed to guide improvement efforts in schools where 
students' MCAS performance is not at a level that reaches the school’s Adequate Yearly Progress 
targets in English language arts or mathematics or both. The Paul Dever Elementary School met 
these criteria and was one of sixteen schools selected for panel review in winter, 2004. The 
panel review was conducted on Feb. 2-3, 2004. 


The review panel's charge was to analyze data and written information on the school's 
performance and improvement efforts, visit the school, and meet with school and district 
officials in order to advise the Commissioner on the answers to the following two key questions: 
1. Does the school have a sound plan for improving student performance? 
2. Are the conditions in place for the successful implementation of the school's 
improvement plan(s)? 


The panel's responses to the two key questions that defined the scope of its review are included 
in this report. These findings and conclusions are the product of the panel's analysis, discussion, 
and observation, based on the evidence available to it. A list of panel members who participated 
in the review is provided in Appendix A. A detailed schedule of the panel's activities is provided 
in Appendix B. 


The panel's findings and conclusions on the two key questions will be forwarded to the 
Commissioner of Education for consideration, together with school performance data, in 
determining whether Dever Elementary School is deemed under-performing. The panel was not 
asked to formulate a sound plan for school improvement where such a plan does not presently 
exist or to recommend a course of action to create the conditions for successful implementation 
of sound improvement strategies where such conditions at present do not appear to exist. 
Diagnostic and/or prescriptive intervention, where needed to assist an under-performing school, 
occurs at the next stage of the school review process. 


Paul Dever Elementary School Profile 


Enrollment 
The Paul Dever School is one of 83 elementary schools in Boston. The school serves students in 
“oy DOCS kindergarten through grade 5. Preliminary tabulations show 496 students enrolled at the school 


306 as of October 1, 2003. Over the last four years, student enrollment at this school has averaged 
»B7M355 500. From 2001 to 2004, the percentage of Hispanic students increased by 10 percentage points, 
Liat from 36 to 46 percent. Meanwhile the percentage of Asians decreased from 10 to five percent; 
and the proportion of Whites went from 16 to nine percent. Black students were the only 
unaffected group, whose average was 38.5 percent between 2001 and 2004. 
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This year, an average of 93 percent of the student attending the Dever School is reported to be 
low-income. The percentage of students for whom English is not the first language fluctuated 
between 41 and 48 percent between 2001 and 2004. The percentage of Limited English 
Proficient students (LEP) during this time frame varied between 24 and 36 percent. Nineteen 
percent of students are receiving special education this year, the same proportion as last year. 


In 2003, the Dever School’s attendance rate fell below the state’s 92 percent minimum to 86.8 

percent. On average, students missed 10 school days that year. Last year, retentions fell to 5.9 

percent from 9.3 percent in 2002. Out-of-school suspensions peaked at 17.6 percent in 2003— 
that is almost three times the state’s 6.1 average. 


Staff 


This academic year, the Dever School reported having a staff of 47 that includes two 
administrators, one guidance counselor, one librarian, one nurse, one specialist, seven teacher 
aides, and 36 teachers. Forty percent of the staff has been at the school for fewer than five years. 
Three of the school’s teachers are not certified. 


MCAS Overview 


Students at the Dever School are assessed in English language arts (ELA) in grade 3 and 4, and 
in mathematics in grade 4. In 2003, the school did not make Adequate Yearly Progress (AYP) in 
ELA in the aggregate and for all its subgroups, except for Hispanic. ' Since 1999, the school has 
failed to make AYP in ELA. In mathematics, the school has also failed to make AYP since 
1999. In 2003, it made AYP only for Hispanic. 


Student Performance in English Language Arts 
GRADE 3 
Regular Education 


The performance of grade 3 Regular Education students in ELA has been relatively static over 
the last three years. When the test was first administered in 2001, 35 percent of students were 
proficient, 50 percent performed at the Needs Improvement level, and 15 percent at Warning. 
The distribution of student performance remained the same in 2002. In 2003, 37 percent of 
students reached proficiency, 53 percent were in need of improvement, and 11 percent performed 
at Warning. 


' In accordance with the federal No Child Left Behind Act passed in 2001, student performance is disaggregated by 
the following subgroups: Limited English Proficient, Special Education, Free/Reduced Lunch, A frican- 
American/Black, Asian or Pacific Islander, Hispanic, Native American, and White. A minimum of 20 students per 
subgroup is required to issue a statistically sound rating or determination of Adequate Yearly Progress (AYP). The 
subgroups meeting the minimum sample size at the Dever School in 2003 were Free/Reduced Lunch, Special 
Education, Limited English Proficient, African-American/Black, and Hispanic in ELA. In mathematics, they were 
Free/Reduced Lunch, Black, and Hispanic. 
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Special Education 


At the grade 3 level, the performance of special education students in ELA got worse every year 
from 2001 to 2003. In 2201, 28 percent of students were proficient. Fifty-two percent 
performed at the Needs Improvement level, and 20 percent at Warning. In 2002, the percentage 
of proficient students dropped by 18 points; 50 percent were in need of improvement, and the 
proportion of those at Warning doubled to 40 percent. Last year, even fewer students, just five 
percent were proficient; 45 percent scored at Needs Improvement; and 50 percent at Warning. 


Limited English Proficient 


In 2003, the Dever School experienced a sharp drop in the proportion of proficient LEP students 
compared to the two previous years. In 2001, 53 percent of LEP students were proficient; 6 
percent scored in the Needs Improvement category; and 41 percent in Warning. The following 
year, the same proportion was proficient as the previous year; Needs Improvement increased to 
11 percent; while Warning fell to 37 percent. In 2003, the percentage of proficient students fell 
to 11 percent. Fifty-six percent performed at the Needs Improvement level; and 33 percent at 
Warning. 


GRADE 4 
Regular Education 


Over the last four years, the performance of regular education students in grade 4 ELA has 
shown consistent improvement. In 2000, there were no proficient students; 69 percent performed 
at the Needs Improvement level and 31 percent at Warning. The following year, 21 percent of 
those assessed were proficient; 48 percent in need of improvement; and 32 percent were at 
Warning. In 2002, the percentage of proficient students rose to 24 percent; 48 percent scored at 
the Needs Improvement level; and 32 percent in Warning. In 2003, 39 percent of students were 
proficient and advanced. The proportion of those performing at the Needs Improvement level to 
44 percent, as did those in Warning to 17 percent. 


Special Education 


Few gains have been made in terms of the performance of special education students in grade 4 
in ELA in the last four years. In 2000, 36 percent of students scored at the Needs Improvement 
level, and the remaining at Warning. In 2001, five percent of students were proficient, 40 
percent in need of improvement, and 55 percent at warning. In 2002, six percent of those tested 
were proficient; 29 percent scored at Needs Improvement; and the percentage of those scoring at 
Warning rose to 65 percent. Last year, 10 percent reached proficiency; 25 percent were in need 
of improvement; and 65 percent at Warning. 


Limited English Proficient 
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In 2000, fewer than 10 LEP students were assessed in grade 4 ELA. In 2001, seven percent of 
those tested were proficient; 47 percent in need of improvement; and another 47 percent scored 
at Warning. In 2002, fewer than 10 students were tested. In 2003, six percent of students 
reached proficiency, 38 percent performed at the Needs Improvement level, and the majority 
(56%) were at Warning. 


Student Performance in Mathematics 
GRADE 4 
Regular Education 


Despite the fluctuations observed in the performance of regular education students at the grade 4 
level in mathematics, little improvement has been made in the last four years. In 2000, four 
percent of students performed at the Proficient level; 50 percent at Needs Improvement; and 48 
percent at Warning. The following year, the proportion of proficient students rose to nine 
percent; 42 percent were in need of improvement; and 48 performed at Warning. In 2002, 14 of 
those assessed were proficient; 40 percent scored at Needs Improvement; and 45 percent at 
Warning. Last year, 10 percent performed at the Proficient and Advanced levels. Forty-nine 
percent were in need of improvement, while 42 percent were at Warning. 


Special Education 


The performance of special education students in grade 4 mathematics has varied over the last 
four years, but still no signs of improvement are evident. In 2000, nine percent of those assessed 
were advanced; 18 percent scored in the Needs Improvement category; and 73 percent at 
Warning. In 2001, student performance was evenly divided between the Needs Improvement 
and Warning levels. The next year, 11 percent reached proficiency; six percent were in need of 
improvement, and the proportion of those who scored at the Warning level jumped by 33 
percentage points to 83. In 2003, 35 percent of students performed at the Needs Improvement 
level; and 65 percent at Warning. 


Limited English Proficient 


In 2000, there were no LEP students enrolled in grade 4 mathematics at the Dever School. In 
2001, 12 percent of LEP students were proficient and advanced; 33 percent were in need of 
improvement; and 56 percent performed at the Warning level. In 2002, fewer than 10 LEP 
students were assessed. Last year, 65 percent of students performed at the Needs Improvement 
level, and 35 percent at Warning. 
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PANEL RESPONSES TO THE KEY QUESTIONS 


KEY QUESTION 1: DOES THE SCHOOL HAVE A SOUND PLAN FOR IMPROVING 
STUDENT PERFORMANCE? 


Yes. The Dever has a Whole School Improvement Plan (WSIP) for improving student 
performance. The plan includes analysis of both summative and formative assessments to 
identify student weaknesses. It sets out improvement objectives/priorities, root causes and 
improvement strategies. The weakness of the written plan is its identification of broad priorities 
that are difficult to measure, root causes not deeply grounded in the reasons for poor student 
performance and few improvement strategies that focus on instructional practices that address 
student weaknesses. 


A. Has the school analyzed appropriate data and program information to accurately 
identify the gaps in student performance and determined why those gaps exist? 


With the help of district personnel, Dever has examined MCAS results and formative assessment 
data to determine areas of student weakness. They have not conducted a thorough review of 
academic programs and instructional practices, but they are addressing gaps in that area through 
an extensive professional development program. The gaps in student learning are broad but 
clearly linked to the school’s analysis, and they have begun to identify some likely reasons why 
student learning gaps exist. 


The district launched a new template and development process for Whole School Improvement 
Plans (WSIP) for 2003-2004. The district’s school support specialist assigned to the Dever, 
completed a thorough MCAS data analysis and presented it to the school’s Instructional 
Leadership Team (IIT). The ILT used the data packets to identify areas of student weakness in 
ELA and mathematics for all students. The school also analyzed formative assessment data in 
ELA (Diagnostic Reading Assessment, Scholastic Reading Inventory, Writing Prompts) and — 
math (TERC Jnvestigations baseline, mid and end of year assessments) to gauge a clearer picture 
of student needs. The math leadership team (MLT) and grade level teams (GLT) were involved 
in data analysis that contributed to identifying school-wide priorities. 


The school has reportedly aligned their curriculum to the Massachusetts State Curriculum 
Frameworks, Boston Public School Learning Standards and Course Guides. District departments 
do some of the curricular alignments through the development of pacing guides. This 1s the case 
with the TERC /nvestigations curriculum. However, teachers are expected to be more 
resourceful to carefully align the content used in the Readers ’/Writers’ Workshop model to the 
state frameworks. The principal created room in the daily schedule for common planning time 
for grade level teams to meet once a week for 50 minutes. At the beginning of the school year, 
GLTs use common planning time to develop curriculum maps. These maps are reviewed by the 
principal and either approved or returned to GLTs for revision. Currently there is no system in 
place to monitor teacher’s coverage of the learning standards within the framework of the 
Workshop model. Teacher interviews reveal this is now being done in most grade level teams or 
individually with support from the school based ELA and math coaches. 


Winter 2004 Massachusetts Department of Education 
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Many of the causes identified in the four objectives identified for ELA and math appear to stem 
directly from the variations in level of teachers’ implementation of district-mandated programs 
(TERC Jnvestigations and Readers ’/Writers’ Workshop) across classrooms and grade levels. In 
an attempt to bring uniformity to the quality of instruction, Dever staff is required to participate 
in a minimum of 30 contractual hours of professional development. The plan calls for each 
teacher to participate in three Collaborative Coaching and Learning (CCL) cycles per school year 
(ELA, math and inquiry). The school’s literacy and math coaches are in charge of facilitating the 
CCL cycles. Each cycle lasts eight weeks and focuses on program implementation issues as well 
as addressing priorities identified in the Whole School Improvement Plan (WSIP). Grade level 
teams (GLT) participate in cycles together. In all but one of the ten scheduled classroom 
observations and subsequent individual interviews during the panel visit, there was solid 
evidence that teachers were implementing /nvestigations and the strategies of Readers '/Writers’ 
Workshop. However, in response to the survey statement, “curriculum implemented in our 
school is effective and appropriate,” 39 percent of the 38 respondents either disagreed or were 
not sure. When asked to evaluate the “availability and adequacy of the following supports from 
your district—curriculum guidance/implementation,” 75 percent responded “available, but not 
adequate.” These responses suggest less than full confidence that the academic program is 
sufficiently strong at the Dever. 


In the school’s Leadership Report and in interviews with the Deputy Superintendent and the 
principal, there is consistency in the identification and priorities of student weaknesses. The 
WSIP includes five priority student learning objectives -- two in ELA, two in math, and one in 
sheltered English immersion. Each priority/objective was identified based on weaknesses 
identified through data analysis. However some gaps exist. The school has not clearly articulated 
its understanding of the root causes of these priorities. Some of the root causes listed are directly 
connected to the priority but many more are not. For example, Math Priority #2 states, “Students 
will be able to access information and draw conclusions from data that is visually represented in 
a variety of ways (i.e. graphs, charts, schedules).” Under this priority the WSIP lists six root 
causes, only one of which is a root cause under the school’s control: “not enough relevant 
material within the curriculum or supplemental material to address this weakness area”. The 
additional five root causes simply restate student weaknesses identified in the data. 


The lack of depth of the root causal analysis also leads to a gap in the action plans between 
addressing the learning needs identified for “‘all” students and the need to specify strategies and 
learning objectives/priorities for the various special needs programs/students. In addition, the 
school disaggregated data by ethnic groups (Hispanic and African American) and identified 
student weaknesses specific to these students, then failed to identify root causes or instructional 
strategies to address their identified academic weaknesses. In the DOE staff survey and in 
interviews, teachers identified “effective instructional methods for diverse learners” among their 
top three priorities for professional development as a weakness in the academic program at the 
Dever, suggesting they are aware of their role in improving student learning. 


In previous years Boston’s template for creating a WSIP required schools to identify priorities 


under Boston’s six essentials; 1) Focus on literacy and mathematics, 2) Use student work and 
data to identify student needs, improve instruction and assess progress, 3) Focus professional 
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development to offer teachers and principals the skills they need to improve instructional, 4) 
identify and replicate best practices for instruction, 5) align all resources with the instructional 
focus, 6) engage families, community and partners to support Whole School Improvement. 
Under the current WSIP there is no place for the school to list problems they have identified such 
as attendance (86 percent/25 percent chronically absent at Dever), discipline/out-of-school 
suspensions (17.6 percent Dever vs. 8.8 percent district) and home support. In the current WSIP, 
these factors appear as root causes under ELA and math instructional priorities. 


B. Does the plan set out specific improvement objectives that are grounded in the school’s 
analysis of the reasons for poor student performance? 


Yes. The Dever’s WSIP lists learning objectives for student skills as well as SMART Goals for 
student performance, as measured by formative and summative assessment. The five priority 
objectives all have a focus on teaching and learning in math and ELA and sheltered English 
instruction, and are connected to the weaknesses identified by the school in its data analysis. 


The majority of the SMART goals are directly tied to specific findings in areas of identified 
weakness, with the exception of ELA Priority #2 that focuses on writing. The WSIP offers no 
data to support writing as an instructional priority. The rest of the data analysis provided in the 
WSIP gives a clear picture of the specific ELA and math skills students are struggling with. As 
the school identified objectives/priorities, they grouped most of the specific weaknesses into one 
or two umbrella priorities. The result is broad priorities that become difficult to address and 
measure. For example 2002 MCAS analysis revealed that student have problems: 

= using visual information and images to interpret and solve problems 

" using pictures to support understanding of what is being asked of them 

« knowing how to interpret a chart and fractions 

« fractions a general issue for all levels 

= weakness in geometry 

"vocabulary and graphing 


The school took these six specific weakness areas and created two math priorities: 

" Math Priority #1: “Students will be able to read and understand the question a math 
problem is posing to determine what is being asked and will be able to apply appropriate 
problem solving strategies”. 

"Math Priority #2: “Students will be able to construct, draw, conclusions and use 
information that is represented visually in a variety of representations’. 


Focusing broadly on covering most of the weakness areas in geometry, fractions, math 
vocabulary, word problems and graphing, within two priorities makes it difficult to link specific 
instructional strategies to specific causes on the one hand, and to measure student progress that 
results from any particular strategies on the other. While grouping under more comprehensive 
priorities may simplify the final document, it loses some of the particular aspects of the 
curriculum that require attention by teachers. 


Winter 2004 Massachusetts Department of Education 


(b lanoiterntead svoradt or yon qo ghia oh 
leninAatesaet ut. hw esowarih: ite doe tS aa ps 7k 
para orqad icrod aber ‘4 tip ethene ie . mailionss oy ore 1 
Hoss toiliesbi sad Yospentitdore il of oda odtath pone ay net TOW meres 9 
[oo JOR ayizeith Avot ts vest eRe otcrerdly Soren; aNarirtaty anes ats a0 

ae 2 tresyinr9 cal? re eeu Sunn salts LSP Se RES ev. tors toot OF 1 Ve 
bir nlOtay Manalf ow Sant ent bun 4 a l5p abr 2arys ter en igeqan-« 


af 
e*toodee ont bt lolytuety sre ders covitssplo tasismiaqet sitiaeg: imo 12 weby ont i 
Ne ale: ssoneieniises weahiute ineg Wl ean ces7. 3 Wo eiegige 
: P : i , . ; ) y La 


* Ga <8 Fe ‘ ‘ _— sanel GED! f, , 
b sot vient) FAL ch \idurds othine potpara Wit tay invalid’ gain! areil NW a'nventl g J 
' ( HOME o¢ = Sit testo A ha ih | eR LY sagt) ¥ tb Nae 46 9a eg 
: 
¥. | Nasri baiaile bhe AIT ovata) abo ine uriises! mo 2ucet 6 one Oe 
. 4 ra 1 ec! : f ¢] rie 2 sis oa’ sy "ye te si fads “4 ' 
: fe 7t oul RGi rh fale Moe ¢ uo J iars tye F WS att DMG o} fart hd | 093 oe 278 sys . 
} ‘wee An wer al Sn riiast alabemen Pe Bsus voon TSAM? arth t see 
fo MISO’ TO, aricxTe fii Zab, SIRINS Te GINS Visoo ia? Si On bse AEG Sis ra yt 
” - é - 
: of zistie fe 'W eu? aneryl oo aoauus Tel) Se vine|)ns An le moresoxe sel) ty 
n 3 fo bubryortr re. Pe vee Hens Oo ag o iT Voto 2501 MITZI 1S 46 aShitTw Tins? ‘ 
p ‘ mr ox ‘ , - 
iW Stules.nle ous 2rbute et de niet Sas Ao ofits orl? fo wasiotg weld ae 
anh Gi) seneanZ nae On a8 aril 50 heath: PRQqUOTw Y &: Y gotinonnd zevitsovdo boriinekr ie 
| tii rrpia @! Hinge Sjoved ta eae bend ar lives oT eothyorr) alia 


| isle bails Jer! Lolsaven atayvlane 2A. Ms S00 siqmia xs 1047 
ited rs} arsleiy {te PUTTS SARS res EV RITT! pi oF ‘6ren ser! +e u2iVv Qt : 


gilt to. osee aod of teow ho omsbnatarsbau frog l2 o) aero whee 

| annie bee resis é tsi¢naiul of wod yale y 

bt :~ glovel {In vol -swert lersise OIE 

( YUSMGLe ean, iaawr” 
; . oid hen vi laden. 
eo) | aa 

| ube be ably Os hateote tyte asois e2oningw office e Xie tet toot Teiey 
ddatrh oe rent ot? Srnteyabr bow busy ob aidu od Ure atmobuie 12 inedttt digi 

Sit Male ysits 5 (tte i Of vic at thy one 1 bowze sins at Tathr fr unismetab oF ginizs OG tH eral doit 
we estualnita gravice “isis, 
sey {ras endlawioine . web | ‘eapteaos of olds od Hew atnsbia2” 88 ytivor ait Nee 
sortiginermngs: to vier y 2 ru -vilasuer batnsesnyat ai tot aeelaecewal 


Dac zxodaant semen mt aerm mecdese tcl Yeo tore aniiswos 20 vibeow 

oftiosge Anil on oath Waswa weiter ow vidi goidqeng baw getshiorw brow , 
ind’ Bory cay sashyle sHiensds-oF bn lnand sro oil no 2oe ues ORIGINe ot Nong ates ta 
svienoinaines gio mobad golem oliSW Jodo ort no cocysente tahiti erie 6 - 
ati Yo eicrvqan iehusinag art? % ow aseol 1b Jnuenwvob bait gel tise ee | 
erodonnt onan shana 


: ae ee f Men 
7 ‘ . _ s 


* 


Panel Review Report, Winter ‘04 Paul Dever Elementary School page 8 


SMART Goals for MCAS for “all” students are set by the district and aimed primarily at meeting 
AYP. For example for ELA Priority #1 one MCAS goal to “Increase the percent of all students 
performing advanced or proficient level on the Reading MCAS from 24% in 2003 to 40% in 
2004,” is not anchored in any analysis conducted by the ILT of feasibility or reasonableness. A 
formative assessment goal for the same priority reads, “In primary grades, 85% of all students 
will achieve minimum proficiency on the DRA Spring assessment.” Formative assessment goals 
do not include 2003 performance data making it impossible to gauge whether the goal is 
reasonable and achievable. 


While the five priority objectives are grounded in the school’s analysis of poor student 
performance, they are broad and will be difficult to measure. Although weaknesses in student 
learning among special needs students are identified in the plan, there is insufficient analysis of 
the root causes for gaps in student performance by these specific populations to formulate 
specific learning objectives or performance goals for these students. The plan does offer 
strategies to directly address the needs of ELL students, including the scaffolding of lessons and 
the development of teacher capacity to perform solid assessment of student progress, but the 
objective to “improve general academic literacy for English language learners in all content 
areas” is vague. There are no SMART Goals listed for special needs student performance in any 
area. 


C. In order to accomplish each improvement objective, does the plan specify strategies, 
which appear likely to lead to improved student results? 


Not in every case. One can discern connections between the majority of instructional strategies 
outlined in the WSIP action plans and the learning objectives/priorities, but the logical link to 
those strategies from specific root causes are not always apparent. Implementation of the 
strategies outlined in the action plans that directly align with the priority objectives is likely to 
have an impact on student performance. 


The plan lacks instructional focus and alignment between root causes to instructional strategies. 
The majority of the root causes are not grounded in deep analysis of the reasons for poor student 
performance often focusing on issues outside the realm teachers control such as: home support, 
lack of previous WSIPs, and students’ lack of skills. Likewise the majority of instructional 
strategies selected do not appear to offer specific instructional guidance that can improve 
teachers’ instruction and lead to better student results. For example, ELA Priority #1 focuses on 
inferential and literal comprehension across genres. Six root causes are listed, three of which 
focus on instruction. For the same priority, nine strategies are listed, yet only four focus on 
specific instructional strategies that teachers can employ to address inferential and literal 
comprehension. In spite the lack of direction and clarity the WSIP offers, teachers observed and 
interviewed are finding the resources needed to properly address this priority, and CCL cycles 
help grade level teams by modeling lessons and providing specific instructional strategies 
teachers can use in their daily instruction. 


Some of the strategies used by a second grade teacher (who was observed and interviewed) to 
help her students comprehend inferentially and literally across genres are: questioning, 
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predicting, making connections with text, inferencing, and making pictures in your mind. Yet 
none of these strategies are listed in the WSIP but are being used and discussed in CCL cycles as 
evidenced by posters of similar strategies posted in a fifth grade classroom of another teacher. A 
fifth grade teacher was observed helping his students’ comprehension of the novel “Journey to 
‘Jo burg’” by teaching students to write their connection to the text (text to self, text to text, text 
to world) on sticky notes that appeared on practically every page of the students book. This 
metacognition strategy of helping students know ways readers connect or disconnect with text is 
not listed in the WSIP, but represents an effective technique teachers have employed beyond the 
suggestions of the WSIP. Some of the instructional strategies listed in the WSIP to help teachers 
address ELA priority #1 (inferential and literal comprehension across genres), are: 
= “uniformly implement and enforce school-based rules that promote and optimal teaching 
and learning environment; there will also be an emphasis on developing in students 
habits of work, and independent working and social competency skills 
* develop and enhance home-school communication and involvement, through workshops, 
collaborative book responses, school-sponsored book fair and author-related literacy day, 
and classroom publishing events that encourage the participation of all school 
community members 
= LAB teachers will be full participants in all professional development activities 
= begin to match students to ‘just-right’ books and develop in students the ability to self- 
select appropriate books” 


The instructional strategies listed above are not likely to tell teachers how they can help their 
students with inferential and literal comprehension. However successful implementation of some 
of the other strategies that directly address teachers’ instruction on inferential and literal 
comprehension would impact student performance since comprehension helps students with 
critical analysis of text/genres. Here are examples of strategies listed for ELA priority #1 that are 
connected to teaching: 

» ‘All teachers will integrate the use of multi-genre literature and will model inferencing 
and literal understanding, using think-aloud strategies and other comprehension-based 
strategies during mini-lesson, read aloud, shared reading, guided reading and literature 
circles. 

= develop or identify units of student that include explicit instruction in the identification 
and characteristics of different genres 

= design or acquire a series of specific mini-lessons and conferences that address the ability 
to infer from different types of text 

= inthe primary grades, the DRA will be administered, and teachers’ guided reading and 
conferring notes will be examined, to determine level of inferential comprehension.” 


Some teachers find the resources they need to address WSIP priorities while other teachers 
interviewed in focus groups expressed a need for more clarity and direction from the WSIP as to 
how to address each priority. 


The few strategies that are embedded to district programs such as TERC /nvestigations and 
Readers '/Writers’ Workshop are research-based. It is difficult to gauge the level of effectiveness 
of these research-based programs in Boston to date. However, the programs have shown success 
in other schools and districts. Our interview with the Deputy revealed that many of the schools 
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under his supervision identified common student weaknesses in ELA and math. Low MCAS 
scores for the Boston District confirm students are not acquiring the skills they need to succeed 
on the MCAS; yet to date no district wide program analysis has been performed to evaluate the 
effectiveness of the district’s curriculum and determine if it is appropriate to address students’ 
needs. 


D. Are the school’s written improvement planning document (s) clear and specific enough 
to guide their implementation of planned improvement initiatives? 


No. The absence of clear alignment between identified priorities, root causes, and instructional 
strategies makes it unlikely that the written plan alone can serve as a clear guide to 
implementation. Together with the WSIP Implementation Benchmarks document that 
accompanies the action plans and work being done in grade level teams around specifying the 
strategies that are most effective, the plan appears to be providing a useable school wide guide 
for grade level teams and teachers as they work to put the strategies into practice in their 
classrooms. According to interviews and focus groups with teachers, with the School Site 
Council, and with the ILT, the WISP is enabling them to implement the strategies. 


The Dever WSIP has the components needed in a plan: analysis of student weaknesses and 
identified priorities, root causes, strategies, timelines, person responsible, on-going 
measurement, and SMART goals. However, both the content and format of the action plan lacks 
clear guidance to improvement initiatives. As mentioned in sections A-C of this report, the 
priorities identified are broad and difficult to measure, the root cause do not focus enough on 
instructional reasons for poor student performance, and the strategies lack specific instructional 
guidance or focus to help teachers address student weaknesses. The vertical format of the action 
plan does not allow the reader to easily follow the connections between a root cause, 
instructional strategy to address root cause, timeline, person/people responsible, measurement of 
strategy’s effectiveness and end-of-year SMART goal. 


The action plan in the WSIP does not specify in-house resources or external resources needed to 
implement the strategies in the plan. During the interview with the Deputy Superintendent and 
the principal they cited additional resources the school needs such as a Director of Instruction, 
classroom libraries, additional professional development hours, and strong instructional 
leadership from the Assistant Principal and the LAB Cluster Director. The school has resources 
not reflected in the WSIP. For example the Compass and Citizens programs offer supplemental 
support for a significant number of the school’s third, fourth and fifth grade students. In addition, 
interviews with program directors explained how these programs provide an important 
connection to the home-school relationship the Dever is working hard to achieve. There is no 
place to list these resources that help the school meet the needs of the students in the template for 
the WSIP. 


E. Was the School Improvement Pian developed through a process that will support its 
successful implementation? 


Yes. The Dever WSIP was the result of a process including staff, coaches and school support 
groups. This representation included the Instructional Leadership Team (ILT), Grade Level 
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Teams (GLT), Math Leadership Team (MLT), and School Site Council (SSC), all of whom are 
stakeholders in the successful implementation of this plan. Teacher interview indicate the staff 
understands and accepts their role and responsibility for implementing the WSIP. 


The principal involved a representative group in creating the WSIP. The leadership report and 
ILT interview echo the process that involved a long-term study and analysis of the spring 2002 
MCAS data. This analysis included a test item analysis, a critical look at patterns of weakness, 
determination of priorities and alignment to both the district’s and the state’s learning standards. 
Further analysis of formative assessment was conducted, and all findings were reported back to 
the ILT and incorporated into the WSIP. The ILT met continuously for the later half of school 
year 2002-2003, went on a retreat, involved grade level teams, scheduled a professional 
development day to present findings to the entire staff and sought their input. Grade level teams 
helped identify five priority areas (two ELA, two math, and one sheltered English immersion) 
and helped identify root causes for each. However, the ILT and the MLT identified the bulk of 
the root causes and approved the list as it appears in the WSIP. Other stakeholders involved in 
the WSIP development were the coaches, the director of the Citizens after school program, and 
the district school support specialist. 


Grade level teams, principal learning walks, individual teachers, and CCL cycles regularly 
review progress toward implementation of WSIP priorities. On going review and monitoring of 
the WSIP happens during common planning time where grade level teams discuss progress 
toward priorities. Agendas and minutes are turned in to the Principal and kept in grade level 
binders in his office. A quick review of the minutes reveals that the majority of the GLT 
conversations center on WSIP priorities and instructional practice. The principal also conducts 
learning walks and provides feedback to teachers. Samples of learning walk feedback were 
provided for the Panel Review team. The feedback holds teachers to high expectations not only 
of themselves but also of their students. It is specific, outlining exactly what needs to change and 
by when, and it is focused on critical teaching and learning issues that have a direct impact on 
student achievement. Teachers receiving feedback from a learning walk have no question as to 
what they need to do to meet the level of expectation communicated and modeled by the 
principal. In addition, the principal participates in a monthly support program for first year 
principals. The deputy for triad A initiated and facilitates an inquiry group for these principals. A 
cohort of visiting principals will visit the Dever and focus on how second language learners are 
accessing the TERC curriculum. Also, individual teachers use a variety of assessments to 
monitor individual or class attainment of targeted skill. This assessment is on-going and serves to 
adjust instruction, revisit skills, and individualize/differentiate instruction based on results of 
assessments. The principal offers flexibility for teachers to cover WSIP priorities. Lastly, in CCL 
cycles teachers’ focus on the identified instructional strategies through observation and 
discussion about student work, assessment data, instructional practice, best practice, and overall 
reflection of their effectiveness toward improving student achievement. 


Teachers interviewed by Panel team members cite the WSIP as having a strong presence in 
guiding instruction at Dever, due largely to the absence of such a document in past years and the 
focus and conversations the plan has generated since its creation. As such, the plan is tied into 
professional development and guides professional development training and district initiatives 
(TERC, Readers’/Writers’ Workshop). The Principal has communicated high expectations for 
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strict adherence to addressing student weaknesses identified in the WSIP. Teachers refer to the 
WSIP as a “blueprint”, and feel it has “created focus” and “teacher accountability” not felt in a 
long time. Nine out of ten classroom observations conducted by the Panel Review team revealed 
strong evidence that teachers were implementing the priorities listed in the plan either through 
direct instruction or through the plethora of posters outlining instruction in choosing “just right 
books”, inferential comprehension, representing fractions visually, and more. In interviews, 
special needs teachers claimed they are focusing on the learning standards for the first time and 
that the WSIP has changed their instruction. 


Staff understands their role in and responsibility for the implementation of WSIP strategies. 
However, some staff responsible for second language learners and special needs students did 
express frustration with the WSIPs shortcoming in meeting their student population’s needs. 
While the WSIP effectively focuses and guides staff, and has led to positive changes in 
instruction, it was noted the plan fails to offer specific instructional strategies for these student 
populations. 


Evaluation of WSIP’s usefulness is determined by standard student performance assessments in 
addition to the staff's unique assessment practices. These assessments assist Dever staff in 
making needed adjustments. In focus groups and individual teacher interviews, the Panel Review 
team heard of a number of assessments used by individual teachers not reflected in the WSIP. 
Teachers are monitoring their own implementation of the WSIP and making adjustments to their 
instruction. Two teachers interviewed continue to analyze MCAS data of their class to 
individualize instruction based on students’ weaknesses. Additional assessments used and 
mentioned by teachers during interviews include: read alouds, informal observations, student 
check-in with their partner/buddy, conferencing, reader’s response journals, and looking at 
student work (LASW). Teachers report using the results to “guide instruction, supplement weak 
areas, or secure support for individual students.” 


KEY QUESTION 2: ARE THE CONDITIONS IN PLACE FOR THE SUCCESSFUL 
IMPLEMENTATION OF THE IMPROVEMENT PLAN(S)? 


Yes. The principal has created a vision of high expectations for the entire Dever community. The 
staff is cohesively implementing both strategies outlined in the WSIP and researched by 
individual teachers with the support of the ELA and math coaches. Using district criteria for 
WSIP approval, the team questioned the quality of support the Dever received by approving their 
plan. The district offers a number of financial and human resources to the school and the 
principal beyond the standard, including a forthcoming Director of Instruction and a Second 
Language Acquisition Coach for the language center. 
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A. Does the school have effective leadership and sound management? 


Yes. Interviews with all stakeholders expressed consistent belief in the principal’s ability to 
communicate effectively, nurture a positive school climate, set high expectations, and lead with 
confidence and purpose. The Dever staff expressed confidence in the principal’s managerial and 
instructional leadership. 


Interviews with teachers, students, administrators, ILT and SSC members, collectively expressed 
a vision for the Dever of high expectations for all students. The principal has effectively modeled 
and communicated his vision and expectation of high standards for the Dever community as 
evidenced by the same answer to the question, “Describe your vision for the Dever.” His 
Leadership report is clear and thorough, painting a picture of the work that he has done and his 
belief in distributed leadership. Members of the ILT and SSC for more than 2 years explained 
that the principal created a new sense of purpose, and “revitalized” and “empowered” these 
groups. The instructional leadership team and the school site council both feel their work is 
critical to fulfill the vision of the school. The principal has encouraged additional leaders 1n the 
school by assigning ILT members lead roles in their grade level teams. 


The principal nurtures and supports a positive school climate and recognizes the importance of a 
strong morale. He works 16-hour days as reported by the deputy and his teachers, making 
himself available and accessible to teachers at any time. His staff reports that he is inclusive and 
that he listens. Upon assignment as principal to the Dever he surveyed the staff and asked 
questions to help him understand the school’s most pressing needs. He began by addressing 
issues of discipline, parent involvement/home support, scheduling and operational issues. He 
addressed the two major areas of home support and discipline by enabling the specialist staff to 
develop a parent volunteer program with over 100 parent volunteers and developing a new code 
of conduct with input from various stakeholders. As reported by staff members, he is proactive 
and responsive to teacher needs and students’ needs as evidenced by his successful partnership 
with three mental health agencies that provide counseling services to families and their children. 
The partnership serves the needs of over 40 students at any given time through services provided 
by clinical therapist and counselors. Teachers feel he is listening to their concerns and addressing 
them by working with them to help all students succeed. 


The principal guides improvement efforts with confidence, energy and purpose. The Dever 
school does not qualify for an Assistant Principal based on numbers; however the Principal 
presented his school’s case to the district and was able to get an Assistant Principal based on how 
close their enrollment was for assigning the position and the demanding programs housed at this 
school (ELL and LAB). He also wanted additional instructional support for his teachers and was 
able to set funds aside for a Director of Instruction, a position not commonly seen at the 
elementary level in Boston. He effectively focuses on high expectations, models lessons, and 
provides insightful feedback that impacts classroom instruction. Part of his vision is not only 
high expectations of students but of himself and his teachers. 


In the teacher survey, 98 percent of the staff agreed or strongly agreed that the principal provides 


effective leadership to guide and support staff efforts to improve the academic performance of 
Dever students (DOE survey). A 17-year teacher at the Dever feels “inspired by the changes seen 
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in the past two years.”’ The deputy recognized the principal’s ability to “secure a core group of 
teachers, and foresees the pendulum swinging in the principal’s favor that will likely lead to 
notable improvements in the 2004 MCAS”’. His vigorous pursuit of solutions to important school 
issues such as parent involvement and home support sends a strong message that he cares about 
the academic, social and emotional needs of every student. 


B. Is there evidence that the school’s faculty supports the planned improvement 
efforts? 


Yes. Staff consistently referred to the WSIP as being a focus for their instruction, which would 
lead to improved student performance. It is regarded as a document which is continually 
referenced by both staff and leadership. 


The WSIP priorities were consistently referred to and confirmed as the most significant 
instructional areas of concern across grade levels. These findings were mentioned in focus 
groups and teacher interviews. The staff survey administered by the DOE reported 90 percent of 
the staff strongly agree or agree that the school has a well-defined plan for reaching student 
performance goals. The same survey asks teachers what they are expected to do, according to the 
school’s plan, to improve student performance. Teachers overwhelmingly responded with 
references to priorities identified in the WSIP. 


There is less agreement with regards to the support behind the identified improvement strategies. 
The appropriateness of some strategies to all grade levels and to all specialists 1s missing in the 
written plan as mentioned in Question 1 section C. However, these staff members have an 
understanding that they are responsible and expected to make the appropriate adaptations needed 
to address student weaknesses. Teachers suggested additional strategies, which would be useful, 
yet not mentioned in the WSIP. One example of this would be the need for cross grade 
collaboration. Analysis of a fifth grade writing prompt discovered writing weaknesses which 
were not unique to fifth graders yet were consistent across grade levels. Opportunities for 
teachers to collaborate with adjacent grades and across grades would facilitate identification of 
important cross grade level skills in need of attention. 


In focus group interviews, teachers reported that the WSIP has “created a collegial culture in the 
building that was not present before.” Staff firmly believes that the plan has created a “central 
focus point” where “everyone has one thing in common.” Teacher’s confidence in the WSIP are 
encouraged by the improvement seen in mid-year math assessment results and increases in SRI 
scores. Students who usually met benchmarks in June are meeting them in September. Since 
students met district-set benchmarks (Level 2) early in the year, these teachers are aiming for 
students to score Level 3 or better by June—they report they “want proficiency for their students 
and their students know it”. A notable improvement in climate, culture, and parent support is also 
attributed to the WSIP. 


The inclusive nature of the WSIP development has created overall involvement and engagement 


with the plan. Visual evidence in classrooms demonstrates teachers are focusing instruction on 
identified student needs. Ninety percent of classroom observations focused on ELA or math 
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priorities identified in the plan. The Dever staff is actively engaged in implementing the school’s 
improvement initiatives. The WSIP has not only focused the staff around a common vision but 
continue to generates discussion around student achievement and teaching and learning. 


The principal, assistant principal, LAB Director, CCL cycles and coaches all have responsibility 
to monitor instructional practice. The principal and the assistant principal conduct classroom 
visits, they model lessons and give feedback. The principal has numerous conversations with 
teachers about their teaching and feels he is making important connections with his staff through 
these conversations. The CCL cycles provide a rich environment for teachers to reflect on best 
practices, model lessons, or observe coaches modeling lessons. 


C. Is the school receiving adequate guidance and support from the district leadership? 


Yes. The Deputy Superintendent displayed familiarity with the most pressing needs of the 
school, and with strategies/practices already implemented during the principal’s two-year tenure. 
Additional supports, in the form of human resources and training, have been or will reportedly be 
provided to facilitate implementation of planned improvement initiatives. 


The district leader is in constant communication with the principal and was able to articulate the 
same needs of the school as the principal cited in his Leadership Report and interview. The 
deputy expressed his confidence in the school leader, believes the school is turning around and 
the 2004 MCAS results will show improvement. The team confirmed some of the needs 
identified by the deputy. Other needs were not confirmed due to the limited sample of teachers 
scheduled for observation. 


The deputy was not directly involved in the development of the WSIP but reviewed and 
approved the plan. The criterion described and used by the deputy to evaluate the WSIP is based 
on alignment of key components such as data analysis, priorities, root causes, strategies and 
professional development. After reviewing the plan the Panel Review team did not see the 
logical links that led to the approval of this WSIP. Furthermore, using the same alignment 
criteria described by the deputy, the Panel Review team would not agree with the approval of the 
Dever WSIP. 


The school receives additional supports for being a school identified as being under “corrective 
action”. These additional supports include school support specialist, after school tutoring, and a 
director of instruction. Other supports the district offers to the Dever and to other Boston 
elementary schools are ELA and math coaches and an assistant principal. 


In addition, the principal receives support from numerous sources including a cluster principals 
peer support group, professional development consisting of learning walks, a new principal 
support network, a second-year principal support network, and help from the instructional leader 
and the deputy superintendent. The principal lists additional district supports in his Leadership 
Report including access to the on-line system—MyBP5S, Reading Recovery support for 
struggling readers, Language Acquisition Coach, increase support from the Educational Team 
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Facilitator (ETF), and content based professional development around Readers /Writers’ 
Workshop and TERC Investigations. 


A good working relationship is reported to exist between the district and the school leadership. 


CONCLUSION 


The Panel Review team found that the Dever has a plan for improving student performance that 
it has begun to implement. The plan as written goes much of the way toward a ‘sound’ plan. It 
currently lacks clear alignment between key elements; perhaps reflecting an early stage of 
development which can be addressed as they continue to revise and refine their improvement 
plans. While the school identified areas of student weakness, it did not articulate a clear 
understanding of the reasons for poor student performance which limited their ability to specify 
the improvement strategies needed to address these weaknesses. On the other hand, the staff 
sees the plan as the guiding document that will lead to improvement, and has apparently taken 
ownership of addressing each priority identified in the plan. This is due, at least in part, to the 
principal’s strong leadership and clear vision of high expectation for all—students, teachers, 
support staff, parents and himself. With the addition of a promised Director of Instruction and 
the maintenance of other supports already provided, the conditions should be in place for the 
school to successfully implement its plans for improvement. 
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APPENDIX A 
Team Members 


Emilys Pefia, Panel Chairperson, SchoolWorks Consultant, Beverly, MA 

Denise Delorey, PhD., Panel Coordinator, DOE, Malden, MA 

Denise C. Fronius, Principal, Ayer Public School, Ayer, MA 

Kristyn Rice, School Support Specialist, Lawrence Public Schools, Lawrence, MA 


Ilene Pearson, Director of Title I Early Childhood, Melrose Public Schools, Melrose, MA 
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APPENDIX B 


UNDER-PERFORMING PANEL REVIEW SCHEDULE 
Detailed Schedule for Review Panel School Site Visit 


The times specified on the following schedule may be adjusted slightly to align with the 
daily schedule and practices in each of the schools being reviewed. 


Day 1 

10:30—12:00 Panel chairperson and panel coordinator meet to discuss and clarify roles, prepare 
for the first team meeting, and review general logistics/schedule for the review. 
[location: hotel] 

12:00—2:00 p.m. Team meeting # 1: team meets for the first time to discuss each panelist’s 
individual analysis; team forms preliminary judgements on key questions. 
[location: hotel] 

2:00—3:00 p.m. Panelists meet with the district Superintendent (and Assistant Superintendent, if 
appropriate). [location: hotel] 

3:30—4:30 p.m. Panelists meet with Principal (and one other school-based individual, if 
appropriate). [location: the school] 

6:00—8:00 p.m. Team meeting # 2: panelists synthesize interview information, further define 
findings, prepare questions, and develop a team strategy for Day 2 of the review. 
[location: hotel] 

Day 2 
All activities take place in the school 

7:30—8:00 a.m. Panelists meet with the Principal 

8:00—8:30 a.m. Panelists meet with the School Council 

8:30—9:00 a.m. Panelists meet with Focus Groups. The Panel Review Coordinator and the 


Principal will identify participants for each Focus Group. The groups will be 
organized, as appropriate, to include groups of individuals who can respond to 
questions designed for parents, students, classroom teachers, curriculum ~ 
facilitators, content-area specialists, grade-level instructors, or other specific 


inquiry groups. 


Focus Group 
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9:00—11:00 a.m. Classroom observations and teacher interviews* 


| |S PanelistA | PanelistB_ [| PanelistC | PanelistD | PanelistE | 


9-10 a.m. Observe Observe Observe Observe Observe 
teacher 1 and teacher 3 and teacher 5 and teacher 7 and teacher 9 and 
teacher 2 teacher 4 teacher 6 teacher 8 teacher 10 


10-11 a.m. Interview Interview Interview Interview Interview 


teacher 1 and teacher 3 and teacher 5 and teacher 7 and teacher 9 and 
teacher 2 teacher 4 teacher 6 teacher 8 teacher 10 
individually individually individually individually individually 


11 a.m.—12:30 p.m. Team meeting # 3: panelists meet to discuss findings so far and to plan the 
remainder of the day (working lunch) 


12:30—1:00 p.m. Panelists use time as needed to analyze findings and to gather more information; 
panelists are encouraged to roam the entire school and visit classrooms not yet 
seen. 

1:00—2:00 p.m. Panelists meet with teachers in groups*; consultant co-chair is free to work on 
report 


| dS PanelistA | PanelistB | PanelistC | PanelistD | PanelistE | 
1:00-1:30 Teacher Focus Group 1 Teacher Focus Group 3 | Prepare report 
1:30-2:00 Teacher Focus Group 2 Teacher Focus Group 4 


2:00—2:30 p.m. Closing meeting with the principal to discuss next steps (all panelists are present) 


2:30—5:00 p.m. Team meeting # 4: panelists deliberate and form conclusions 
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